Evaluating ChatGPT's Decimal Skills and Feedback Generation in a Digital Learning Game

While open-ended self-explanations have been shown to promote robust learning in multiple studies, they pose significant challenges to automated grading and feedback in technology-enhanced learning, due to the unconstrained nature of the students' input. Our work investigates whether recent advances in Large Language Models, and in particular ChatGPT, can address this issue. Using decimal exercises and student data from a prior study of the learning game Decimal Point, with more than 5,000 open-ended self-explanation responses, we investigate ChatGPT's capability in (1) solving the in-game exercises, (2) determining the correctness of students' answers, and (3) providing meaningful feedback to incorrect answers. Our results showed that ChatGPT can respond well to conceptual questions, but struggled with decimal place values and number line problems. In addition, it was able to accurately assess the correctness of 75% of the students' answers and generated generally high-quality feedback, similar to human instructors. We conclude with a discussion of ChatGPT's strengths and weaknesses and suggest several venues for extending its use cases in digital teaching and learning.Comment: Be accepted as a Research Paper in 18th European Conference on Technology Enhanced Learnin

Exploring creative thinking in graphically mediated synchronous dialogues

publication-status: Publishedtypes: ArticleThis paper reports on an aspect of the EC funded Argunaut project which researched and developed awareness tools for moderators of online dialogues. In this study we report on an investigation into the nature of creative thinking in online dialogues and whether or not this creative thinking can be coded for and recognized automatically such that moderators can be alerted when creative thinking is occurring or when it has not occurred after a period of time. We outline a dialogic theory of creativity, as the emergence of new perspectives from the interplay of voices, and the testing of this theory using a range of methods including a coding scheme which combined coding for creative thinking with more established codes for critical thinking, artificial intelligence pattern-matching techniques to see if our codes could be read automatically from maps and ‘key event recall’ interviews to explore the experience of participants. Our findings are that: (1) the emergence of new perspectives in a graphical dialogue map can be recognized by our coding scheme supported by a machine pattern-matching algorithm in a way that can be used to provide awareness indicators for moderators; (2) that the trigger events leading to the emergence of new perspectives in the online dialogues studied were most commonly disagreements and (3) the spatial representation of messages in a graphically mediated synchronous dialogue environment such as Digalo may offer more affordance for creativity than the much more common scrolling text chat environments. All these findings support the usefulness of our new account of creativity in online dialogues based on dialogic theory and demonstrate that this account can be operationalised through machine coding in a way that can be turned into alerts for moderators

Computer-Supported Argumentation Learning: A Survey of Teachers, Researchers, and System Developers

Abstract. Argumentation is omnipresent in our lives and therefore an important skill to learn. While classic face-to-face argumentation and debate has advantages in helping people learn to argue better, it does not scale up, limited by teacher time and availability. Computer-supported argumentation (CSA) is a viable alternative in learning to argue, currently increasing in popularity. In this paper, we present results from a survey we conducted with experts on argu-mentation learning systems, one which provides a glimpse on future directions

Mindfulness in a digital math learning game:Insights from two randomized controlled trials

BackgroundMindfulness practices enhance executive function skills and academic achievement, spurring interest in integrating mindfulness interventions into education. Embedding mindfulness practice into a digital math game may provide a low-cost, scalable way to induce mindfulness and boost game-based learning, yet this approach remains unexplored.ObjectivesWe investigated the learning benefits of integrating mindfulness exercises in a digital math learning game and examined how students' trait mindfulness might moderate the outcomes.MethodsTwo classroom studies were conducted with 404 5th and 6th grade students from six public schools in the U.S. (nStudy 1 = 227, nStudy 2 = 177). The two randomized controlled experiments assigned students to one of the three conditions: passive control (playing the digital learning game Decimal Point), story-enriched active control, or mindfulness-enriched condition. Trait mindfulness, learning gains, and in-game problem-solving (including problem-solving duration, error count and correctness after reminder) were assessed. Study 2 included a manipulation check to better understand the effects of the mindfulness intervention.ResultsFindings showed no significant differences in learning gains, problem-solving duration or error count among the conditions. Students' trait mindfulness did not moderate these outcomes. Mindfulness reminders in the mindfulness-enriched game led to more correct answers after errors than jokes in the story-enriched game. Study 2 revealed that we failed to induce higher state mindfulness through the mindfulness inductions.ConclusionsMindfulness prompts could be especially beneficial for students experiencing frustration during gameplay, warranting more exploration for digital game-based instruction. We highlight barriers and future directions for fostering mindfulness through computer-based instruction in classrooms

Identifying objectives for a learning space management system with value-focused thinking.

A classroom with a blackboard and some rows of desks is obsolete in special education. Depending on the needs, some students may need more tactile and inspiring surroundings with various pedagogical accessories while others benefit from a simplified environment without unnecessary stimuli. This understanding is applied to a new Finnish special education school building with open and adaptable learning spaces. We have joined the initiative creation process by developing software support for these new spaces in the form of a learning space management system. Participatory design and value-focused thinking were implemented to elicit the actual values of all the stakeholders involved and transform them into software implementation objectives. This paper reports interesting insights about the elicitation process of the objectives

Towards an Intelligent Tutor for Mathematical Proofs

Computer-supported learning is an increasingly important form of study since it allows for independent learning and individualized instruction. In this paper, we discuss a novel approach to developing an intelligent tutoring system for teaching textbook-style mathematical proofs. We characterize the particularities of the domain and discuss common ITS design models. Our approach is motivated by phenomena found in a corpus of tutorial dialogs that were collected in a Wizard-of-Oz experiment. We show how an intelligent tutor for textbook-style mathematical proofs can be built on top of an adapted assertion-level proof assistant by reusing representations and proof search strategies originally developed for automated and interactive theorem proving. The resulting prototype was successfully evaluated on a corpus of tutorial dialogs and yields good results.Comment: In Proceedings THedu'11, arXiv:1202.453